Psychometric  Analysis  of  the  Low  Vision 
Diagnostic  Assessment  Procedure 


Edward  P.  Cerla ' ,  Ph . D. 
University  of  Louisville 
American  Printing  House  for  the  Blind 

Earl  F.  Rankin,  Ph.D. 
University  of  Kentucky 

Debbi  e  II .  Wi  1 1  i  s  ,  B .  A- 
American  Printing  House  for  the  Blind 


,  thv.  ^ 

R(cah 

uouisvt'-^- 


Running  Head:  Psychometric  Analysis 


Abstract 


Psyche i  ,jlrc  Analysis 

T 


A  psychometric  analysis  was  conducted  on  the  Diagnostic  Assess:. .ui.t 
Procedure  (DAP)  which  evaluates  the  visual  efficiency  of  low  vision 
legally  blind  persons.  The  DAP  was  administered  twice  to  eacr,  of 
112  legally  blind  students  ages  5-20.  Reliability  coefficients  showed 
that  the  DAP  was  highly  internally  ccnsistert  (KR-20  =  .94)  and  highly 
accurate  (test-retest,  r  =  .96).  The  hierarchical  nature  of  the  DAP 
and  its  content  and  construct  validity  were  evaluated  and  are  dis¬ 


cussed. 
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Psychometric  Ana.ysis  of  the  Lew  Vision 
Diagnostic  Assessment  Procedure 

A  Program  to  Develop  Efficiency  in  Visual  Functioning  is  current!., 
being  developed  by  the  American  Printing  House  for  the  Blind  ir.  ccl- 
laboration  with  Barraga  and  ner  colleagues  (Darraga  &  Collins,  .9 73. 
Barraga,  Collins,  SHollis,  1S77).  This  pro. ram  grew  out  of  icrr&g 
earlier  work  (Barraga,  1S64)  wnich  demonstrated  that  legally  olirc  pL  - 
sons  with  severe  visual  handicaps  could  be  systematically  taugnt  to  ir- 

4 

crease  the  efficiency  with  which  they  use  their  remaining  vision.  Sub¬ 
sequent  research  by  Ashcroft,  Halliday,  &  Barraga  (1965)  and  nol  s 
(1967)  replicated  and  extended  Barraga 's  work.  The  program  currently 
under  development  represents  a  substantive  modification  of  the  earlier 

v/ork. 

The  Program  currently  under  development  consists  of  a  40  item  as- 
sessment  procedure,  a  set  of  15C  lessons  which  are  keyed  to  specific 
sections  of  tr.e  assessment  procedure,  and  accompanying  source  book.  Tic 
purpose  of  the  assessment  procedure  is  to  evaluate  a  person's  current 
level  of  visual  functioning  in  order  to  plan  a  systematic  program  cf 
visual  training  designed  to  increase  the  efficiency  with  which  che 
person  will  use  his/her  remaining  vision.  The  assessment  procedure  car. 
also  be  used  to  determine  progress  following  a  period  of  training. 

The  purpese  of  this  article  is  to  report  the  outcome  of  a  psycho¬ 
metric  analysis  of  the  low  vision  assessment  procedure  which  was  carrie a 
out  during  the-  fall  of  1978. 
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3. 


S.ibjects 

The  subjects  for  this  study  were  selected  on  the  basis  of  the  fol¬ 
lowing  criteria: 

1.  a  minimum  developmental  level  of  5.o  years  in  ago 

a  minimum  of  1  year  in  a  structured  educational  setting 
(kindergarten  and  up) 

legally  blind  (20/200  visual  acuity  or  less  in  the  better  eye 
with  corrective  lens  or  a  visual  field  of  20  degrees  or  less) 
with  a  minimum  of  light  perception 

4.  no  additional  physical  or  mental  handicaps  that  would  interfer 
with  oerformance  on  the  test 

The  subjects  were  112  legally  blind  pups  is  attending  schools  in  cn 
United  States  (California,  Georgia,  Kansas,  New  Hampshire,  New  York, 
Oregon,  Texas,  Massachusetts,  Washington)  and  Canada  (Ontario).  All  su 
jects  were  volunteers.  There  were  60  males  (54%)  and  52  temaies  (46:0 
with  89  subjects  from  public  schools  (79%)  end  23  subjects  from  resi¬ 
dential  schools  (21%).  Eacn  subject  was  classified  into  one  of  nine 
visual  categories  using  the  classification  system  of  visual  acui -y  pro¬ 
posed  by  the  National  Society  for  the  Prevertion  ov  Blindness,  re:  t-- 
purposes  of  this  study  another  category  (X)  was  added  to  take  into 
account  those  subjects  who  hac  only  restrictions  in  visual  fields  oi 
less  than  20°  but  whose  visual  acuities  were  greater  than  20/200.  Tne 
number  and  percentage  of  subjects  in  each  of  the  visual  categories  is 
shown  in  Table  1.  These  proportions  compare  favorably  to  those  reporte 
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Insert  Table  1  about  here 

by  Willis  (1975)  using  the  1976  quota  registration  figures  of  .  c 
legally  blind  students  attending  residential  and  public  schools  ir 
the  United  Stases  as  compiled  by  the  American  Printing  House  tor  the 
Blind.  Consequently,  the  results  of  this  study  car  oe  generalise  :c 
the  legally  blind  population  of  school  age  students.  The  reae tr 

note  that  totally  blind  children  were  excluded  from  this  study  ^r.d, 

« 

consequently,  there  were  no  students  classified  in  category  IX. 

The  incidence  of  the  eye  disorders/causes  represented  in  the  s ob¬ 
jects  is  shown  in  Table  2.  The  reader  should  note  that  the  total  inci¬ 
dence  of  211  exceeds  the  samp'e  size  of  112  because  most  of  the  subjects 
were  diagnosed  as  having  more  than  a  single  eye  disorder.  The  large 
number  of  eye  disorders  in  the  sample  attests  to  the  great  heeerog.  .  ' 
of  visual  disabilities  in  the  population. 

The  subjects'  ages  ranged  from  5-20  years.  The  median  age  was  1C. 5 
years . 


Insert  lable  2  about  here 

Method 

Materials 

Diagnostic  Assessment  Procedure  (DAP) 

The  DAP  consists  of  40  items  ranging  from  the  simple  item  of  dot. 
ing  a  light  to  the  most  difficult  items  of  writing  letters  and  read  n,:* 
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simple  words.  The  40  items  of  the  DAP  are  broken  down  into 
cories  that  correspond  to  speciiic  functiona;  visua.  tasks.  Because- 
certain  categories  were  more  heterogeneous  than  others ,  a  different 
number  of  questions  were  required  to  adequately  sample  the  behaviors 
in  the  different  categories.  The  eight  categories  with  the  number  of 
items  in  each  category  (shown  in  parentheses),  along  with  examples  o, 
test  objectives,  are  as  rollows: 

A.  Awareness  of  visual  stimuli  (2) 

Item  No.  1.  "Learner  moves  eyes,  head  and/or  body  to  light 

source." 

E.  Movement  control  of  eyes,  discrimination  of  shape  and  color  vO 
Item  No.  3.  "Learner  will  look  from  one  light  to  the  other.1, 

C.  Exploration,  discrimination,  use  of  objects  (6) 

Item  No.  7.  "Learner  will  see  two  lines  and  move  between  them. 

D.  Discrimination  and  identification  of  pictures  Oi  oojects,  - 
actions  (12) 

Item  No.  14.  "Learner  will  match  solid  color  geometric  shapes 
in  pictures." 

C.  Memory  for  detail,  part  whole  relationships,  rigure-ground  dis- 
.  crimination  (4) 

Item  No.  25.  "Learner  wi  11  identify  object  partially  hieder.  i  . 
picture." 

F.  Discrimination,  identification,  reproduction  ov  abstract  *  ,  y. .  c 
and  symbols  (4) 

I tern 'No.  29.  "Learner  will  match  abstract  figures  by  single 


inner  detai 1 . " 


6.  Perception  o •  i  i  a  - 1  cr....r.  i ,  s  in  pictures,  .  cst.  u  u ; ' 

bols  (4) 

Item  No.  33.  "Learner  will  relate  inner  detail  in  fig. .-a  of 
different  si2e." 

■H.  Identification,  perception,  reproduction  of  symbols  of  single 
and  combined  symbols  (4) 

Item  No.  37.  "Learner  will  identify  letters  in  different  types. 

Each  item  specifies  the  visual  task,  the  materials,  the  c.  rectior.s 

: 

for  administering  the  item,  and  the  speci-fic  response  requires  of  the 
learner  in  order  so  be  considered  correct. 

All  materials  necessary  for  administering  an  item  are  self- conte 
Procedure 

Twelve  teachers  of  the  visually  handicapped  were  selectee  to  be  e  . 
uators.  The  criteria  for  selection  were  as  follows: 

1.  Interest  in  participating 

2.  Experienced  in' testing  procedures,  specifically  in  using  the 
Visual  Efficiency  Scale  (Barrage,  1965)  for  the  assessment  of 
low  vision 

3.  Access  to  at  least  10  students  who  met  the  criteria  for  partici¬ 
pation  in  the  study. 

Each  teacher  was  required  tc  attend  a  2  1/2  day  training  session  he. id  at 
tne  American  Printing  House  for  the  Blind  during  the  summer  of  lii 7c. 
During  the  trai  ling  session  the  rationale  of  the  program  was  given  ulo.v 
with  a  demonstration  in  administering  the  entire  assessment  procedure. 
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The-  teacher-evaluators  then  returned  to  their  respective  communities  to 

assess  their  students.  Each  teacher-eva  uator  was  asked  lo  tes..  and 
retest  each  student  within  a  period  of  not  less  than  2  nor  more  than  3 
Weoks  during  the  fall  of  1978.  Tne  teacher-evaluators  were  paid  for 
their  participation  in  the  training  session  and  for  each  set  of  test- 
re  test  protocols  that  were  returned  to  APH. 

Results  c.r.a  Discussion 

This  instrument  was  examined  from  both  a  content  validity  as  well 
as  from  a  psychometric  standpoint.  Both  ‘these  standpoints  are  essential 
to  the  users  cf  this  instrument  because  a  person's  performance  on  the 
categories  of  the  test  are  more  important  to  the  examiner  than  the  'total 
test  score  (i.e.,  educational  planning  and  educational  intervention  will 
be  based  on  performance  within  the  eight  categories  rather  than  on  the  • 
test  as  a  whole). 

The  content  validity  of  the  Diagnostic  Assessment  Procedure  is.  quite 
good.  In  constructing  one  test  the  developers  reported  reviewing  over 
100  articles  and  books  on  visual  perception,  normal  visual  development, 
visual  impairment,  and  low  vision.  In  addition,  14  professions , s 
the  areasof  visual  perception,  low  vision,  and  teachers  of  the  visual :i 
handicapped  served  as  consultants  on  the  project.  The  literature  review 
and  the  input  from  the  consultants  provided  the  basis  for  the  de' ejoprmr't 
of  the  eight  functional  visual  categories  aid  the  specific  items  on  the 
instrument.  The  eight  categories  of  the  instrument  appear  to  be  very  cc 
prehensive  in  covering  the  full  range  of  visual  functioning.  In  add*,  me:. 
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the  items  on  the  ins; rument  are  re,  reucntative  of  no  vi .. 

that  would  be  necessary  in  performing  a  wide  range  of  school  related 

visual  tasks. 

The  means,  standard  deviations,  and  standard  errors  of  tne 
for  the  test- retest  protocols  are  shown  in  Table  3.  The  averag.  sub¬ 
ject  obtained  a  score  of  approximately  70%  on  both  the  test  and  ret-  t 
indicating  that  the  DAP  was  rather  easy.  A  statistical  test  fc.  ; 
ness  of  the  distribution  was  significant  (jd  <.05).  Visual  inspection 
of  the  distribution  showed  a  negative  skeweo  curve  witn.  most  scores 
piled  up  at  the  high  end  of  the  distribution. 


Insert  Table  3  about  here 

A  comparison'  of  the  means  and  standard  deviations  for  both  the  te. : 

and  retest  demonstrated  a  high  degree  of  consistency  of  visual  functi,.- 

ing  over  the  period  between  test  and  re  test  with  respect  to  both  averag-. 

level  and  degree  of  homogeneity  among  individuals  in  the  group.  The 

small  standard  error  of  the  mean  indicates'  that  there  is  a  probability 

of  £  <1.01  that  the  mean  score  for  the  population  is  less  than  two  po 

on  either  sice  of  the  test  or  retest  means. 

« 

Item  Analysis 

No  negatively  discriminating  items  were  found  as  a  result  of  ciese. 
the  test  or  retest.  However,  there  were  a  "ew  items  which  deviated  sub¬ 
stantially  in  difficulty  from  ocher  items  on  the  test  which  warranted 
special  attention.  Table  4  shows  the  list  of  difficult  items  for  hot. 
the  test  and  retest.  It  should  be  noted  that  the  same  items  war;  -.'o-  - 
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to  be  difficult  on  both  the  test  and  retest.  An  analysis  of  these  items 
revealed  that  they  tended  to  demand  drawing  and  graphic  man i,  o «ati ve 
skills  which  predictably  would  be  dirficuit  .or  persons  with  visual  hand 

caps. 


Insert  Table  4  about  here 


Reliability  estimates  for  the  DAP  were  based  upon  internal  consis¬ 
tency  coefficients  (i.e.,  Kuder-Richardsen  20)  and  correlations  i.etwcc.'. 
test  anJ  retest  results.  The  reliability  coefficients  arc  scan^a. o 
errors  of  measurement  are  shown  in  iabie  o.  The  i  .ten  na  *  consistency  s . 
both  the  test  and  retest  were  identical  and  very  high,  _r  =  .94.  Tne 
errors  of  measurement  were  extremely  smal  i ,  and  i  ~  can  be  concludes  — >. 
an  individual's  true  visual  efficiency •  score  would  probably  (£_  <  .68.) 
he  found  within  plus  or  minus  two  points  on  either  sice  of  his  score  as 
measured  by  this  test.  The  test- retest  correlation  was  r  =  .96  which, 
indicates  that  the  DAP  is  a  highly  accurate  instrument  and  that  the  type 
of  visual  functioning  measured  by  the  DAP  does  not  vary  much  from  week 
to  week. 


Insert  iabie  5  about  here 


Hierarchial  -ecuence 

It  could  be  hypothesized  that  a  hierarchical  sequence  from  easy  uc 
difficult  items  exists  in  the  assessment  procedure.  Such  a  hierarchy 
may  exist  in  one  or  both  of  two  types.  One  type  of  hierarchy  (Type 


Psychometr.  c  Analy.  i  s 

would  exist  if  ;:e  difficulty  of  tne  items  progressed  syst 
from  the  beginning  to  the  eno  of  the  instrument.  Ttris  type  of  hier¬ 
archy  would  produce  a  progressive  decrement  in  the  mean  percentage 
for  categories  A  through  H  which  would  consist  of  clusters  of  items 
organized  sequentially  from  tne  beginning  to  the  end  of  the  ir.stru 
A  second  type  of  hierarchy  (Type  B)  would  be  bases  on  the  assurptic 
that  a  state  of  interdependency  exists  amonc  items  (or  categori  s). 
Success  at  lower  levels  in  the  structure  would  be  necessary  before  an 
individual  could  respond  adequately  to  i ferns  at  higher  levels  in  tne 
hierarchical  structure.  A  Type  A  hierarchy  is  a  necessary  but  not  & 
sufficient  condition  for  a  Type  B  Hierarchy. 

Evidence  for  a  Type  A  Hierarchy 

1.  Hierarchy  of  item  difficulty 

Space  precludes  the  description  .of  item  difficulties  fc 
all  40  items,  but  a  visual  inspection  of  item  difficulty  per 
centages  in  the  item  analysis  print-out  sheet  revealed  a  sV  ; 
but  nonsignificant  tendency  (Kruskal-Wallis  test,  £  >  .05)  for 
later  items  to  be  slightly  more  difficult  than  early  items  in 
the  sequence.  However,  a  number  of  erratic  fluctuations  in 
difficulty  are  in  evidence  from  the  beginning  to  the  end  of 
the  instrument.  Consequently,  this  evidence  does  not  suppe  t 
the  notion  of  a  hierarchy  of  item  difficulty 

2.  Hierarchy  of  category  difficulty 

If  there  is  a  hierarchy  of  category  difficulty  then  there 
should  be  increasing  difficulty  across  categories.  Table  6 
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presents  mean  percentage  scores  for  categories  A-H  for  -  oth 
the  initial  test  and  the  retest  results. 


Insert  Table  6  about  here 


The  rank  order  of  mean  percentages  for  the  initial  test  range  in 
a  descending  h  erarchy  from  a  high  of  94%  fo-  category  A  to  a  low  of 
45%  for  category  H  and  thus  provides  eviaence  for  the  existence-  of  a 
Type  A  hierarchy  for  the  category  structure.  The  retest  results  are 
similarly  hierarchical  in  structure  with  the  exception  of  category  j. 
However,  the  initial  test  provides  better  evidence  for  the  existence 
of  a  hierarchy  because  it  was  not  influenced  by  potential  practice 
effects  that  may  have  occurred  on  the  retest. 

Evidence  for  a  Type  3  Hierarchy 

If  a  state  of  dependency  exists  among  items  (or  categories)  in  a 
hierarc'i.ial  structure  such  that  success  on  tasks  at  a  given  level  . r. 
tne  hierareny  is  dependent  upon  the  mastery  of  other  tasks  at  lower 
levels,  then  correlations  between  items  at  a  particular  ^eve.  and  i tew -o 
at  successively  higher  levels  should  become  progressively  lower,  ti.  . - 
larly,  correlations  between  items  at  a  given  level  and  other  ite...s  ac 
successively  lower  levels  should  become  progressively  lower.  ,wo  dif¬ 
ferent  types  of  analyses  were  conducted  as  follows: 

1.  Items--Tetrachoric  correlations  were  computed  among  ail  ^ossu 
combinations  of  items.  Such  correlations  describe  the  strongs 
or'  the  relationship  between  passing  versus  failing  on  one  itec. 
;and  passing  versus  failing  on  another  item.  Space  does  .  ot 
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permit  a  listing  of  all  of  these  correlations.  However,  u 
can  be  reported  triat  nc-  trend  existed  among  tnesc  correla¬ 
tions  in  keeping  with  the  assumptions  of  a  Type  B  hierarerg 
among  items  in  the  test. 

2.  Categories--Tables -7  and  8  provide  evidence  related  to  tr.o 
possibility  of  a  Type  B  hierarchy  among  categories  A-H. 


Insert  fable  7  about  here 

The  inter-correlations  shown  in  Table  7 'show  a  general  tendency  for 
relation  trends  to  conform  to  predictions  made  from  the  assumption  a 
Type  B  hierarchy.  Tne  encircled  correlation  coefficients  in  Table  I 
represent  deviations  from  the  predicted  trends.  A  summary  of  results 
in  Table  8  shows  that  73%  of  the.-  correlations  were  in  keeping  wi  tr.  • 
nierarchial  hypothesis .  However,  the  correlations  among  all  categor: .. 
(including  those  far  removed  from  a  given  category  level)  are  too 
to  permit  the  conclusion  that  an  individual  who  does  not  succeec  at  a 
particular  level  cannon  succeed  at  higher  levels  cf  visual  functioning. 


Insert  Table  8  about  here 

,.  t 

In  summary,  for  individual  items,  no  evidence  exists  to  support  the 
assumption  of  either  type  of  hierarchy.  At  the  level  of  categories,  . 
ever,  it  can  be  concluded  that  a  Type  A  hierarchy  exists  but  not  a  Type 
hierarchy.  In  other  words,  significant  differences  in  difficulty  ex  so 
as  one  proceeds  from  the  ear'y  category  of  items  to  the  later  catego. 
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in  this  test,  however*  r.... ,,y  OAceptions  exi_t  to  tit  notion  t..u t  .  atcr 
categories  canr.ot  be  responded  to  adequately  by  an  individual  who  does 
not  succeed  at  lower  categories. 

Construct  VaV  dltv  of  Categories  A-H 

A  factor  analysis  was  conducted  on  the  initial  test  results.  Tnc 
factor  analysis  revealed  that  one  factor  accounted  for  91%  of  the  vari¬ 
ance  and  a  second  factor  accounted  for  about  5%  of  the  variance.  Three 
other  factors  were  indicated*  but  were  probaoly  not  valid.  Most  of  the 
items  were  loaded  on  factor  1.  The  second  factor  had  high  factor  load 
ings  on  17  items.  Without  going  into  a  detailed  description  of  these 
results,  it  can  be  said  that  there  was  no  correspondence  between  the 
factor  loading  for  individual  items  and  the  hypothesized  categories  A-.-.. 
If  these  category es  had  construct  validity,  then  items  for  a  giver,  ca;:- 
gory  would  load  highly  on  that  category  but  would  show  low  loadings  c. 
other  categories.  Such  results  were  not  feund. 

Visual  inspection  of  inter-correlations  among  categories  reveal ea 
modest  and  significant  correlations  among  all  categories.  In  fact,  the 
correlations  between  test  and  retest  results  for  the  s amo  categories  were 
not  substantially  larger  than  the  correlations  among  different  categories 
for  the  same  test. 

It  can  t.ierefore  be  concluded  that  these  categories  lack  construct 
validity.  There  is  little  evidence  that  this  test  measures  any  cluster 
of  traits  corresponding  to  the  hypothesized  category  system.  From  a 
measurement  point  of  view,  even  if  these  categories  were  valid,  due  to 
the  high  corrections  among  all  categories,  the  error  of  measurement 
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among  categories  would  :  too  large  to  permit  any  cr.agnosv.-.  .  - 
tation  to  be  placed  upon  differences  among  ce tegory  scores  unless  such 
differences  were  rather  large. 

It  should  be  said,  however,  that  the  requirements  for  factorial 
construct  validity  are  so  rigorous  that  few,  if  any,  psychological  or 
educational  measuring  instruments  meet  such  criteria  today.  Most  pub¬ 
lished  reading  tests,  for  example,  report  substantial  inter- cc  \  .. 
subtest  scores  to-be  used  for  diagnostic  purposes.  Factor  analyse  of 
such  tests  seldom  reveal  factors  corresponding  to  most  subtest  titles. 
Yet,  these  tests  are  obviously  useful  diagnostic  tools.  They  may  dis¬ 
play  adequate  content  validity  and  criterion  related  validity  despite 
the  lack  of  factorial  validity. 

Paradoxically,  despite  the  previously  discussed  results  concern! : 
the  lack  of  construct  validity  of  this  instrument,  it  would  neverthe¬ 
less  be  feasible  to  use  this  category  system  as  a r,  organizational  too' 
for  relating  assessment  results  to  treatment  procedures.  The  rationale 
for  this  decision  would  rest  upon  both  the  substantial  content  valicit 
of  this  instrument  and  an  expected  Type  A  hierarchy  among  categories. 

The  content  of  this  instrument  was  based  upon  a  rational  analysis  by 
professionals  in  the  field  of  the  visually  handicapped  as  well  as  psy¬ 
chologists  who  were  knowledgeable  in  the  field  of  visual  perception. 

If  the  category  structure  were  to  be  used  as  a  diagnostic  tool  jus¬ 
tified  on  pragmatic  if  not  entirely  on  rigorous  psychometric  ground-.  , 
it  would  be  necessary  that  these  categories  possess  a  reasonably  high 

» 

degree  of  reliability  and  a  low  degree  of  measurement  error.  Results 
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in  Tables  6  And  9  provide  -  idenc©  Tor  this  decision. 


Insert  "able  9  about  nere 


It  can  be  seen  that  the  reliability  coefficients  in  Table  9, are 
surprisingly  high  (considering  the  small  number  of  items  in  each  catc- 
tory)  anc  the  errors  of  measurement  are  very  low.  Also,  the  si  mi lari  cy 
between  test  and  retest  means  in  Table  6  indicates  a  remarkable  star. !-. 
in  test  per for  nance  within  each  catetory.  It  should  be  noted,  nowever, 
that  the  reliability  coefficients  (see  Table  9)  for  categories  F  anc 
Ci  arc*  lower  than  the  coefficients  for  the  other  ca^ego.  tes.  Caii_.ul 
c  tudv  should  te  given  to  the  items  in  these  two  ca„ego)  ,es.  ^ :  “S 
for  categories  F  and  G  shown  in  iabiss  7  and  9  a  iso  suggest  tnat  sc  t 
unidentified  problem  exists  among  the  items  in  these  categories.  Tnat 
is  to  say,-  the  predicted  correlation  trends  in  these  Tables  for  cate¬ 
gories  F  and  G  are  less  precise  than  for  most  other  categories. 

Cne  of  ti.e  limitations  of  the  preceding  analysis  concerns  the 
nature  of  the  population  sample.  The  resuits  were  limited  to  tcose 
individuals  who  were  selected  on  the  basis  of  visual  acuity  ov  20/200 
or  less  with  no  additional  handicaps  (menta.  or  physical)  that  might 

t 

interfere  with  their  performance  on  the  tesc.  Furthermore,  ^.  .nc^  t.ne 
population  of  visually  handicapped  persons  is  quite  heterogeneous  wit.i 
respect  to  the  nature  of  the  eye  disorder  as  well  as  visual  acui iy 
and  visual  field,  it  is  an  open  question  as  to  the  nature  of  i e- 
lationship  between  these  visual  characteristics  ar.d  performance  on  tht 
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test.  Empirical ly,  inis  is  a  diffict. piOJicni  -o  inv 

the  small  number  of  persons  that  would  fall  into  a:y  category . 

In  conclusion,  this  is  a  highly  accurate  instrument  which  al.c 
displays  a  high  level  of  content  validity  for  its  purpose.  More  c. 
donee  is  needed  concerning  the  correlation  of  performance  of  thi. 
ment  with  related  variables  to  determine  its  criterion  related  valid 
Within  the  context  of  this  program  the  Diagnostic  Assessment  Prc: 
instrument  seems  ’to  be  well  designed  for  making  e i  ectivo  use  o.  er.- 
ing  procedures  for  individuals. 
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‘The  research  reported  herein  was  performed  pursuant  to  a  grant 
v Grant  No.  G0Q76G5448,  Revision  of  the  Utilization  of  Low  Vision  Kit) 
with  the  Bureau  of  Education  for  the  Handicapped,  U.S.  Office  of 
Education,  Department  of  Health,  Education  and  Welfare  to  the  A  erica., 
Printing  House  for'  the  Blind,  Louisville,  Kentucky.  The  author,  ex¬ 
press  their  appreciation' to  June  Morris,  Director  of  the  Department  . 
Educational  Research,  and  Ami-e  Dennison,  Research  Associate,  from,  tue 
American  Print' ng  House  for  the  Blind  and  Natalie  Barrage  from  me 
University  of  "exas  for  their  aid  throughout  the  entire  project.  Opin¬ 
ions  expressed  in  this  article  are  those  of  the  authors  and  do  not 
represent  the  official  position  of  the  Bureau  of  Education  for  the 
Handicapped. 
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The  Number  ar.d  Proportion  o.  Subjects  in  th  Tesr.no  Samp*  e  for 
Each  of  the  Visual  Categories  and  the  Proportion  ol  Subjects  Vo. 
the  1976  Quo- a  Registration  Reported  by  the  Amor  can  Printing  rouse 

Prooortion 


Number 

Proportion 
of  sample 

of  1576  quote 
(Willis,  1979 

I 

20/200  -  18/200 

59 

.54 

.40 

II 

17/200  -  13/200 

5 

.05 

.04 

Ill 

12/200  -  3/2:0 

21 

.19 

.12 

IV 

7/200  -  3./2C0 

4 

.04 

.03 

V 

2.5/200  -  .4/200 

1 

.04 

.01 

VI 

Counts  finger 

7 

.06 

.05 

VII 

Hand  movements  (includes 
"forms"  and  ocject  perception)  5 

.05 

.05 

VIII 

Light  projection  and/or  per¬ 
ception  (includes  shadows) 

6 

.05 

.12 

IX 

Totally  blind 

0 

- 

.13 

X 

Restricted  visual  field 
(20  degrees  or  less) 

2 

.02 

110 

Note.  The  information  on 

two  subjects1 

visual  acuity 

was  incom; -i 

'  and  consequently  the  data. reported  in  this  table  were  based  on  110  suowcC- 
instead  of  112.  The  reader  should  note  that  the  visual  categories  in  this 
study  were  slightly  different  from  those  used  by  Willis  (1979).  If  the 
Willis  data  were  recalculated  to  conform  to  our  category  system,  then  it 
would  slightly  increase  all  of  the  percentages  she  reported.  As  a  conse¬ 
quence,  our  sample  proportions  woulc  approximate  her  population  propo 
even  more  closely  than  they  already  are. 
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Tabic  2 


Dir  gnoses  and/or  Causes  of  the  Eye  Disorders  Represented 
in  the  Testing  Sample  (Arranged  by  Incidence) 


Ra  re  given 
] .  Nystagmus 

2.  Cataracts 

3.  Myopia 

4.  Optic  Atrophy 

5.  Albinism 

6.  Arr.rdia 

7.  Aphakia  (5  indicated  as 

8.  Glaucoma 

9. '  Colomba 

10.  Estotropia 

1 1 .  Mi  crophthalmos 

12.  Retro! entaV  Fibroplasia 


incidence- 
:  38 

22 
13 
13 
11 
9 

surgical)  8 

8 

7 

6 

6 

(RLF)  5 


13.  Eiablyopia  4 

14.  Erucleation  4 

15;  Retinitis  Pigmentosa  4 

16.  Rubella  •  4 

17.  Exotropia  3 

18.  Myopic  Astigmatism  3 

19.  Retinoblastoma  '  3 

20.  Aebiomatopsia  2 

21.  Astigmatism  (see  38,  also  18)  2 


Table  ;  (con..) 

Name  given 

22.  Cor ieal  Scarring 

23.  Hyperopia 

24.  Hypoplasia 

25.  Macular  Degeneration 

26.  Op^ic  Nerve  Damage 

27.  Retinischis 

23.  Abornmal  Macula 

29.  Abnormal  Optic  Nerve  Function 

30.  Anomalies  (multiple) 

31.  Anterior  Clevage  Syndrome 

32. '  Batten's  Disease 

33.  Choroiditoid 

34.  Costs'  Disease 

35.  Corneal  Vascularization 

36.  Gun  Wound 

37.  Histoplasmosis 

33.  Hyperopic  Astigmatism 

39.  Hyperplastic  Primary  Vitreous 

40.  Microcornea 

41.  Myopic  Degeneration 

42.  No  Diagnosis 

43.  Photophobia 

44.  Prosthesis  (same  as  14) 


Psychometric 

Incidence 

2 

2 

2 

2 

2 

2 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 
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Toole  2  (cont.) 

Name  given 
45.  Ptosis 

45.  Retinal  Degeneration 

4/  .  Retinal  Hypoplasia 

Schisis  or  Retina  (see  27) 

48.  Strabismus 

49.  Tape to 

50.  Toxoplasmosis 

51 .  Tumor 

52.  Viral  Encephalitis 


Inc  i  a nee 

1 

1 

1 

1 

1 

1 

1 

1 


Total 


211 


Descripti  ve 

Assessment 

Test 

Retest 
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Table  3 

Statistics  for  the  Test  and  detest  Assessment 


Mean 


Standard 

deviation 


Standard  error 
of  mean 


28.4  (71%) 
28.9  (72%) 


8.5 


8.1 


.81 

.75 
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Table  4 

Difficult  Items  in  Test  ana  Retest  Assessments 


Test  assessment  Retest  assessment 


I  tern 

Difficulty  (%) 

1  tern 

Difficul 

9 

25 

S 

17 

17 

23 

17- 

17 

30  ‘ 

21  • 

30 

9 

34 

12 

34 

11 

37 

26 

37 

22 

3S 

41 

38 

30 
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Assessment 

Tesi 

S^anoard  error 
Retest 

Standard  error 


CO 


Table  r 


e  j 


Reliability  Coefficients  and  Standard  Errors  of 
Measurement  for  the  Test  and  Retest  Assessment 


KR  20 


.94 

2.1 

.94 

1.9 


Test-Retest 
correlati on 


.96 

1.7 

1.6 


4 
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Table  6 


Mean  Percentages  for  Categories  A-H 


or. 

tne  Initial 

lest  and 

Retest 

Category 

Initial  test 
ir.ear 

Retest 

mean 

Number 
of  items 

Initial  test 
mean  percentage 

Retest  u  . 
.jo  ’ '  r  ta 

A  ' 

1.87 

1.91 

2 

94 

96 

B 

3. 57 

3.70 

4 

90 

92 

C 

4.64 

4.63 

6 

77 

77 

D 

8.85 

9.25 

12 

74 

77 

E  . 

2.75 

2.52 

4 

69 

73 

F 

2.69 

2.50 

4 

'67 

62 

G 

2.24 

2.33 

4 

56 

58 

.  H 

1.79 

1.73 

4 

45 

43 

N  -  112 
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Tabic  7 

Correlations  Among  Categories  A-H 
on  the  Initial  Test 


Categories 

A 

B  • 

C 

D 

r. 

F 

r* 

b 

H 

X 

A 

1.00 

.72 

67 

•  V/ 

.59 

.  ‘-3 

© 

.44 

•  C-J 

— > 

< - 

X 

B 

..72 

'..00 

.71 

<© 

•  .  59 

© 

.60 

v 

-  > 

< - 

A 

'  C 

.67 

.71 

1.00 

.72 

.61 

© 

.54 

.  40 

X 

< - 

D  . 

.59 

© 

.72 

1.00 

.76 

.75 

.72 

•  oo 

V 

c 

A 

E 

.43 

.53 

.61 

.75 

1.00 

.62 

Y 

\ 

.  - y 

F 

< 

.61 

© 

© 

© 

.62 

A 

1.00 

.64 

.  O.i. 

X 

* 

<- 

G 

.44 

© 

.54 

© 

© 

.64 

1.00 

.63 

<— 


H 


.25  .38 


.52 


.63  1.00 


_N  =  112 

<— y  Arrows  indicate  direction  of  predicted  trend, 
o  Circles  indicate  deviation  from  predicted  trends. 
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Table  3 

Percentage 

of  Correctly  Predicted  Correlations 

on  the  Initial  Test 

Category 

Percentage 

A 

85 

6 

71 

C 

86 

D 

86 

E 

'71 

F 

6 

,  57 

57 

H 

71 

Mean  =  73% 

N  =  112 

•  -  *  «4 
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Table  9 

Reliability  Coefficients  and  5tanc:.rd  Error  of 
Measurement  for  Categories  A-H 


Standard  error 


Category 

Reliability* 

SD 

of 

measurement 

A 

.  83 

.41 

.17 

B 

.84 

.91 

.  36 

C 

.80 

1.31 

.59 

D 

.89 

2.84 

.94 

E 

.86 

1.26 

.62 

F 

.76 

.97 

.47 

G 

.69 

1.13 

.  63 

H 

.83 

1.44 

•  .59 

N  = 

112 

* 

Corre 

lations  between 

pre  and  post 

assessment. 

** 

Based 

•  cn  pre  assessment  results. 

* 

